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REDUNDANT IMAGING METHODS AND SYSTEMS 



Technical Field 

The present invention concerns imaging arrays and naethods, particularly 
5 methods for correcting or compensating for defective or malfunctioning 
photodetectors in an imaging array. 



Background of the Invention 

Imaging arrays are electronic devices that sense light and output electrical 

10 signals representative of the sensed light. The imaging arrays are generally coupled 
to a television screen, computer monitor, or digital camera, which displays or 
records an image based on the output electrical signals. 

An imaging array often includes a rectangular array or matrix of thousands 
or even millions of photodetectors, with each photodetector having a unique row 

1 5 and column position within the array which corresponds to a particular region, 
known as a pixel, of a displayed image. Each photodetector (or sensor pixel) 
converts sensed light into corresponding electric signals based on the intensity of the 
Ught. The electrical signals are converted into digital signals, comprising ones and 
zeros, which are processed by a digital-signal-processing circuit. This circuit 

20 ultimately outputs image signals to a device for recording or viewing. 

One problem with conventional imaging arrays concems defective or 
malfunctioning photodetectors. Defective photodetectors typically result in 
erroneous image signals that ultimately degrade the quality of resulting images. For 
example, an image based on imaging signals from an imaging array having a 

25 defective photodetector can have a black or dark area at the image region 
corresponding to the defective photodetector. 

One limited solution to this problem has been to identify the defective 
photodetector and to generate a substitute image signal for the image signal of the 
defective photodetector, with the substitute image signal based on an average of the 

30 image signals from detectors surroxmding it. See, for example, U.S. Patent 
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5,854,655 (which is incorporated herein by reference). However, this solution 
suffers from the disadvantage that the substitute image signal introduces artifacts 
into the resulting image. The artifacts reflect the complete loss of information about 
the light actually striking the relatively large area corresponding to the defective 
5 photodetector. 

Accordingly, there is a need for other methods of handUng defective 
photodetectors. 



1 0 imaging arrays and related methods for compensating for defective photodetectors. 
One exemplary embodiment of a new imaging array includes two or more group 
photodetectors, or "group pixels," with each group pixel having two or more 
photodetectors coupled to produce a single group image signal. If the group image 
signal for a group pixel falls below some threshold level indicative of a defective or 

15 malfunctioning photodetector, the group image signal is ampUfied to compensate for 
the loss. 

Various embodiments implement the photodetectors as passive or active 
photodiode circuits, as photogate circuits, as logarithmic sensor pixel circuits, or as 
charge-modulation devices. Some embodiments also implement the photodetectors 
20 as smaller-than-conventional photodetectors, that is, photodetectors having photo- 
sensing elements smaller than conventional elements. 



Summary of Invention 

To address this and other problems, the present inventor devised new 



Figure 1 



Brief Description of the Drawings 

is a block diagram of an exemplary imaging array 100 incorporating 



25 



the invention. 



Figure 2 



is a block diagram of an exemplary group-pixel circuit 200 

incorporating the present invention. 

is a block diagram of an exemplary pixel circuit 300. 



Figure 3 
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Description of the Preferred Embodiments 

The following detailed description, which references and incorporates 
Figiires 1-3, describes and illustrates one or more specific embodiijients of the 
invention. These embodiments, offered not to limit but only to exemplify and teach, 
5 are shown and described in sufficient detail to enable those skilled in the art to 

implement or practice the invention. Thus, where appropriate to avoid obscuring the 
invention, the description may omit certain information known to those of skill in 
the art. 

Figure 1 shows an exemplary imaging array 100 incorporating teachings of 
10 the present invention. Imaging array 100 includes group pixels 1 10, 1 12, 1 14, and 
1 16, an address Une 120, a drain line 130, a reset line 140, and a signal line 150. 
for controlling the group pixels. (For clarity, the figure omits conventional features, 
such as row-select logic, column-select logic, timing-and-control circuitry, and 
analog-to-digital converters.) In the exemplary embodiment, array 100 includes 
15 four group pixels; however, other embodiments include 256x256 arrays, 512x512 
arrays, 1024x1024 arrays. Still larger arrays are also within the scope of the 
invention. 

Each of group pixels 110-116 includes two or more photodetectors, or sensor 
pixels. Group pixel 110 includes sensor pixels 110a, 110b, 110c, and llOd, and 

20 group pixels 1 12, 1 14, and 116 include respective sensor pixels 1 12a-l 12d, 1 14a- 
1 14d, and 1 16a-l 16d. Lines 120, 130, and 140, in the exemplary embodiment, 
control the group pixel in accord with known techniques for addressing and 
controlling conventional sensor pixels in imaging arrays. In some embodiments, 
each group pixels provides a particular output color, such as red, blue, or green. 

25 Figure 2 shows a block diagram of an exemplary group-pixel circuit 200 

applicable to each of group pixels 1 10-1 16 in Figure 1 . Circuit 200 includes N 
sensor pixels, of which sensor pixels 202, 204, 206, and 208 are representative, a 
summer 210, a variable-gain amplifier 212, and an automatic gain controller 214. 
The N pixels 202-206, which operate according to known principles, are coupled to 

30 an input of summer 208, either through direct connection or through a multiplexer 



Attorney Docket 303.615US1 



3 



Micron 99-0112 



(not shown). Some embodiments include one or more analog-to-digital converters 
coupled between the signal lines of the pixels and the summer, depending on 
whether summer 2 1 0 is analog or digital. 

Summer 210 aggregates the N responses of the N pixels 202-206 and outputs 
5 a first aggregate or group image signal to amphfier 212. (Some embodiments 
include in analog-to-digital converter between the summer and the amplifier.) 
Amplifier 212, which in some embodiments is analog and in others is digital, 
ampUfies or scales the first group image signal and outputs a second group image 
signal to automatic gain controller 214 as well as to conventional imaging 

10 processing and display circuitry (not shown.) See U.S. Patent 5,854,655, which is 
incorporated herein by reference. 

Automatic gain controller 214, which is analog or digital, compares the 
second group image signal to an analog or digital reference current or voltage. If the 
comparison indicates that the second group image signal differs from the reference, 

15 controller 212 proportionately changes, that is, increases or decreases, the gain of 
amplifier 210, assxuning that one or more of the N pixels or related interconnective 
circuitry is faulty. In the exemplary embodiment, gain controller 214 sets the gain 
to a factor proportional to the ratio of N, the number of pixels comprising the group 
pixel to M, the number of correctly operating or non-faulty pixels in the group pixel. 

20 To determine the number of non-faulty pixels, some embodiments, check the 

performance of each pixel in each group pixel as a start-up diagnostic test and 
maintain a record of tiie number of faulty or non-faulty pixels in each group pixel. 
Other embodiments dynamically or periodically determine a difference between the 
first aggregate image signal and a reference, and then determine from the difference 

25 how many pixels are faulty. The reference in some embodiments is based on a 
factory test image. 

Figure 3 shows an exemplary sensor pixel circuit 300 applicable to each of 
the pixels in Figures 1 and 2, Circuit 300, a photodiode-type active sensor pixel 
circuit, includes photodiode 310, a source-follower field-effect transistor SF, a row- 
30 select field-effect transistor SL, and a charge-reset field-effect transistor RS, (An n- 
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channel load transistor for source-follower transistor SF is not shown.) Each field- 
effect transistor has respective gate, drain, and source nodes. The circmt further 
includes an address line 320, a drain line 330, a reset line 340, and;a signal line 350. 
In operation, a voltage develops across photodiode 310 based on incident 
5 Ught. AppUcation of appropriate control signals on the gate of transistor SL 
produces an image signal on signal line 350 based on the voltage across the 
photodiode. Signal line 350 couples the image signal to an input node of an analog- 
to-digital converter or summer, such as summer 210 in Figure 2. 

Various embodiments implement the photodetectors as passive or active 

10 photodiode circuits, as photogate circuits, as logarithmic sensor pixel circuits, or as 
charge-modulation devices, (See, for example, Eric R. Fossum, CMOS Image 
Sensors: Electronic Camera-On-A-Chip, 1995 International Electron Devices 
Meeting Digest of Technical Papers, which is incorporated herein by reference.) 
Some embodiments each photodetector occupies a surface area less than 30 square 

15 microns, such as 15 or 25 square microns. Some of these embodiments have a fill 
factor greater than 30 percent. Thus, the present invention is not limited to any 
particular photodetector circuit or class of photodetector circuits. 

Conclusion 

20 In fiutiierance of the art, the inventors have presented new imaging arrays 

and related methods for compensating for defective photodetectors. One exemplary 
embodiment of a new imaging array includes one or more group pixel circuits, each 
of which comprises two or more photodetectors that are substantially smaller than 
conventional photodetectors, for example about 15 or 25 square microns. Each 

25 group pixel circuit produces a single group image signal. The group image signal is 
then scaled or ampUfied to compensate for defective or malfunctioning 
photodetectors. 

The embodiments described above are intended only to illustrate and teach 
one or more ways of practicing or implementing the present invention, not to restrict 
30 its breadth or scope. The scope of the invention intended to encompass all ways of 
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practicing or implementing the principles of the invention, is defined only by the 
following claims and their equivalents. 
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Claims 

1 . An imaging system comprising: 

a group pixel comprising two or more photodetectors for providing two or 

more corresponding pixel image signals; and 
a summer coupled to each of the two or more photodetectors for ou^utting 

an aggregate image signal based on the two or more corresponding 

pixel image signals. 

2. The imaging system of claim 1 wherein the summer comprises an analog-to- 
digital converter. 

3 . An imaging system comprising: 

a group pixel comprising two or more photodetector circuits for providing 
two or more corresponding pixel image signals, with each 
photodetector circuit having a photodiode and occupying a surface 
area less than 50 square microns; and 

a summer coupled to each of the two or more photodetectors for outputting 
an aggregate image signal based on the two or more corresponding 
pixel image signals. 

4. The imaging system of claim 3 wherein the sunGmer comprises an analog-to- 
digital converter. 

5. An imaging system comprising: 

a group pixel comprising two or more photodetector circuits for providing 
two or more corresponding pixel image signals, with each 
photodetector circuit occupying a surface area less than 30 square 
microns and comprising: 

a source-follower transistor have a gate, source, and drain; 
a ground node; and 
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a photodiode coupled between the gate of the source-follower 
transistor and the ground node; and 
a summer coupled to each of the two or more photodetectors for outputting 
an aggregate image signal based on the two or more corresponding 
pixel image signals. 

6. The imaging system of claim 5 wherein the summer comprises an analog-to- 
digital converter. 

7. An imaging system comprising: 

a group pixel comprising two or more photodetectors for providing two or 

more corresponding pixel image signals; 
a summer responsive to the two or more corresponding pixel image signals 

for outputting an aggregate image signal; 
a variable-gain ampUfier responsive to the aggregate image signal for 

outputting an amplified aggregate image signal based on an 

adjustable ampUfier gain; and 
an automatic gain controller for adjusting the adjustable amplifier gain based 

on the aggregate image signal, 

8. The imagmg system of claim 7 wherein the summer comprises an analog-to- 
digital converter. 

9. The imaging system of claim 7 wherem the variable-gain ampUfier is a 
digital amplifier, 

10. An imaging system comprising: 

a group pixel comprising two or more photodetectors for providing two or 
more corresponding pixel image signals; 
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a summer responsive to the two or more corresponding pixel image signals 

for outputting an aggregate image signal; 
a variable-gain amplifier responsive to the aggregate image signal for 

outputting an amplified aggregate image signal based on an 

adjustable ampUfier gain; and 
an automatic gain controller for adjusting the adjustable amplifier gain based 

on the amplified aggregate image signal 

1 1 . The imaging system of claim 10 wherein the summer comprises an analog- 
to-digital converter. 

12. The imaging system of claim 10 wherein the variable-gain ampUfier is a 
digital amplifier. 

13. An imaging system comprising: 

two or more group pixels comprising two or more photodetector circuits for 
providing two or more corresponding pixel image signals, with each 
photodetector circuit having a surface area less than 50 square 
microns and comprising: 

a source-follower transistor have a gate, source, and drain; 
a ground node; and 

a photodiode coupled between the gate of the source-follower 
transistor and the ground node; 
a summer responsive to two or more of the corresponding pixel image 

signals for outputting an aggregate image signal; 
a variable-gain amplifier responsive to the aggregate image signal for 

outputting an amplified aggregate image signal based on an 

adjustable amplifier gain; and 
an automatic gain controller for adjusting the adjustable amplifier gain based 

on the aggregate image signal. 
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14. The imaging system of claim 1 3 wherein the summer comprises an analog- 
to-digital converter. 

1 5 . The imaging system of claim 1 3 wherein the variable-gain amplifier is a 
digital amplifier, 

16. An imaging system comprising: 

two or more group pixels comprising two or more photodetector circuits for 
providing two or more corresponding pixel image signals, with each 
photodetector circuit having a surface area less than 50 square 
microns and comprising: 

a source-follower transistor have a gate, source, and drain; 
a groxmd node; and 

a photodiode coupled between the gate of the source-follower 
transistor and the ground node; 
a summer responsive to two or more of the corresponding pixel image 

signals for outputting an aggregate image signal; 
a variable-gain ampUfier responsive to the aggregate image signal for 

outputting an amphfied aggregate image signal based on an 

adjustable amplifier gain; and 
an automatic gain controller for adjusting the adjustable amplifier gain based 

on the amplified aggregate image signal. 

17. The imaging system of claim 16 wherein the summer comprises an analog- 
to-digital converter. 

18. The imaging system of claim 16 wherein the variable-gain amplifier is a 
digital amplifier. 
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19. An imaging system comprising: 

two or more group pixels comprising two or more photodetector circuits for 
providing two or more corresponding pixel image signals, with each 
photodetector circuit having a surface area less than 50 square 
microns and comprising: 

a source-follower transistor have a gate, source, and drain; 
a ground node; and 

a photodiode coupled between the gate of the source-follower 
transistor and the ground node; 
a summer having an output responsive to two or more of the corresponding 

pixel image signals for outputting an aggregate image signal; 
a variable-gain amplifier having an input, an output, and a gain-control 

terminal, with the input operatively coupled to the output of the 

summer; 

an automatic gain controller having an input coupled to the output of the 
variable-gain ampHfier and having an output operatively coupled to 
the gain-control terminal of the variable-gain ampUfier. 

20. The imaging system of claim 19 wherein the summer comprises an analog- 
to-digital converter. 

21. The imaging system of claim 19 wherein the variable-gain ampUfier is a 
digital amplifier. 

22. A method for compensating for defective or malfimctioning photodetectors 
in an imaging array, comprising: 

aggregating two or more image signals to define an aggregate image signal; 
comparing the aggregate image signal to a reference; and 
amplifying the aggregate image signal based on results of comparing the 
aggregate image signal to the reference. 
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23 . A method comprising : 

aggregating two or more image signals to define an aggregate image signal; 
and 

determining a number of defective or non-defective pixels based on the 
aggregate image signal. 

24. A method comprising: 

aggregating two or more image signals to define an aggregate image signal; 
determining a number of defective or non-defective pixels based on the 

aggregate image signal; and 
ampUfying the aggregate image signal based on the determined number of 

defective or non-defective pixels. 



25 . A method comprising: 

means for aggregating two or more image signals to define an aggregate 
image signal; 

means for determining a number of defective or non-defective pixels based 

on the aggregate image signal; and 
means for amplifying the aggregate image signal based on the determined 

number of defective or non-defective pixels. 



26. An image system comprising: 

means for aggregating two or more image signals to define an aggregate 
image signal; and 

means for determining a number of defective or non-defective pixels based 
on the aggregate image signal. 



27. A method comprising: 

means for aggregating two or more image signals to define an aggregate 
image signal; 
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means for determining a number of defective or non-defective pixels based 

on the aggregate image signal; and 
means for amplifying the aggregate image signal based on .the determined 

number of defective or non-defective pixels. 
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Abstract of the Disclosure 

Imaging arrays are electronic devices that sense light and output electrical 
signals representative of the sensed light. An imaging array comprises thousands or 
millions of photodetectors that convert sensed Ught into corresponding electric 
5 signals, which are ultimately converted into digital image signals for recording or 
viewing. One problem with conventional imaging arrays concerns defective or 
malfunctioning photodetectors. Defective photodetectors typically result in 
erroneous image signals that ultimately degrade the quality of resulting images. 
Accordingly, the present inventors devised new imaging arrays including redundant 

10 photodetectors to compensate for defective photodetectors. One exemplary 

embodiment includes one or more photodetectors that are substantially smaller than 
conventional photodetectors, for example about 10 or 25 square microns. The 
smaller-than-conventional photodetectors are arranged into two or more groups, 
with each group having two or more photodetectors coupled to produce a single 

15 group image signal. If the group image signal for a group falls below some 

threshold level indicative of a defective or malfunctioning photodetector, the group 
image signal is amplified to compensate for the loss. 
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The specification of which is attached hereto. 
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§ 1 12, 1 acknowledge the duty to disclose material information as defined in 37 C.F.R. § 1.56(a) which became 
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faith m dealing with the Office, which includes a duty to disclose to the Office all information known to that individual to be material to 
patentability as defmed in this section. The duty to disclose mformation exists with respect to each pending claim until the claim is canceled 
or withdrawn from consideration, or the application becomes abandoned. Information material to the patentability of a claim that is 
canceled or withdrawn from consideration need not be submitted if the mformation is not material to the patentability of any claim 
remaining under consideration in the application. There is no duty to submit mformation which is not material to the patentability of any 
existing claun. The duty to disclose all mformation known to be material to patentability is deemed to be satisfied if all information known 
to be material to patentability of any claim issued in a patent was cited by the Office or submitted to the Office in the manner prescribed by 
§§ 1 .97(b)-(d) and 1 .98. However, no patent will be granted on an apphcation m connection with which fraud on the Office was practiced 
or attempted or the duty of disclosure was violated through bad faith or intentional misconduct. The Office encourages applicants to 
carefully examine: 

(1) prior art cited in search reports of a foreign patent office in a counterpart application, and 

(2) the closest information over which individuals associated with the filing or prosecution of a patent application beheve any 
pending claim patentably defines, to make sure that any material information contained therein is disclosed to the Office. 

(b) 3 Under this section, information is material to patentability when it is not cumulative to information aheady of record or being 
madd;^ record in the application, and 

r 3 ( 1 ) It estabhshes, by itself or in combination with other information, a prima facie case of unpatentability of a claim; or 

I PI (2) It refutes, or is inconsistent with, a position the applicant takes in: 

' (i) Opposing an argument of unpatentability rehed on by the Office, or 

I ;f (ii) Asserting an argument of patentability. 

A prihfe facie case of unpatentability is established when the information compels a conclusion that a claim is unpatentable under the 
prepdffiierance of evidence, burden-of-proof standard, giving each term in the claun its broadest reasonable construction consistent with the 
specification, and before any consideration is given to evidence which may be submitted in an attempt to estabhsh a contrary conclusion of 
pateqtSbility. 

(c) Individuals associated with the filing or prosecution of a patent apphcation within the meaning of this section are: 

( 1 ) Each inventor named in the application: 

(2) Each attomey or agent who prepares or prosecutes the application; and 

(3) Every other person who is substantively involved in the preparation or prosecution of the application and who is 
associated with the inventor, with the assignee or with anyone to whom there is an obligation to assign the application. 

(d) Individuals other than the attomey, agent or inventor may comply with this section by disclosing information to the attomey, 
agent, or inventor. 



